Apparatus and method for providing media content

ABSTRACT

A system that incorporates teachings of the present disclosure may, for example, receive a request for a telepresence seat at an event, obtain media content comprising event images of the event that are captured by an event camera system, receive images that are captured by a camera system at a user location, and provide the media content and video content representative of the images to a processor for presentation at a display device utilizing a telepresence configuration that simulates the first and second users being present at the event, where the providing of the first and second video content establishes a communication session between the first and second users. Other embodiments are disclosed.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. application Ser. No.14/682,690, filed Apr. 9, 2015, which is a continuation of U.S.application Ser. No. 13/173,310, filed Jun. 30, 2011 (now U.S. Pat. No.9,030,522), which are incorporated herein by reference in theirentirety.

FIELD OF THE DISCLOSURE

The present disclosure relates generally to communication and morespecifically to an apparatus and method for providing media content.

BACKGROUND

Media consumption has become a multibillion dollar industry thatcontinues to grow rapidly. High resolution displays such as highdefinition televisions and high resolution computer monitors can presenttwo-dimensional movies and games with three-dimensional perspectiveImprovements in display, audio, and communication technologies arecausing rapid demand for consumption of all types of media content.Individuals often desire to share their experiences, includingexperiences with respect to media consumption, products and services.The sharing of these experiences is often limited by the capabilities ofcommunication devices being utilized for messaging and the like. Thesharing of these experiences is often limited by factors that areindependent of the communication devices.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 depicts an illustrative embodiment of a communication system thatprovides media services with telepresence;

FIG. 2 depicts an illustrative embodiment of a presentation device andmedia processor for presenting media content that can be used in thesystem of FIG. 1;

FIG. 3 depicts an illustrative embodiment of a viewing apparatus thatcan be used with the presentation device of FIG. 2;

FIG. 4 depicts an illustrative embodiment of a presentation device witha polarized display that can be used in the system of FIG. 1;

FIGS. 5-7 depict illustrative embodiments of communication systems thatprovide media services with telepresence;

FIG. 8 depicts an illustrative embodiment of a method operating inportions of the devices and systems of FIGS. 1-7;

FIG. 9 depicts an illustrative embodiment of a communication system thatprovides media services with telepresence;

FIG. 10 depicts an illustrative embodiment of a method operating inportions of the devices, systems and/or methods of FIGS. 1-9; and

FIG. 11 is a diagrammatic representation of a machine in the form of acomputer system within which a set of instructions, when executed, maycause the machine to perform any one or more of the methodologiesdiscussed herein.

DETAILED DESCRIPTION

This application is related to co-pending U.S. application Ser. No.13/173,281 filed Jun. 30, 2011, entitled “APPARATUS AND METHOD FORMANAGING TELEPRESENCE SESSIONS” by Hines et al., U.S. application Ser.No. 13/168,539 filed Jun. 24, 2011, entitled “APPARATUS AND METHOD FORPRESENTING MEDIA CONTENT WITH TELEPRESENCE” by Hines et al.; and U.S.application Ser. No. 13/168,549 filed on Jun. 24, 2011, entitled“APPARATUS AND METHOD FOR PRESENTING THREE DIMENSIONAL OBJECTS WITHTELEPRESENCE” by Hines et al. The contents of each of the foregoing arehereby incorporated by reference into this application as if set forthherein in full.

The present disclosure describes, among other things, illustrativeembodiments of methods and devices for providing a user with mediacontent of an event that simulates the user being present at the event.The media content can be presented as three dimensional (3D) content.The user can establish communication session(s) with other user(s) thatare presented in conjunction with the media content to simulate the userand other user(s) being present at the event. In one or moreembodiments, the media content can be captured by fixed cameras (e.g.,3D cameras) at the event and users can share the media content capturedby the fixed cameras. In one or more embodiments, the media content canbe captured by a group of cameras (e.g., 3D cameras) at the event wherethe group of cameras is moveable for adjusting the field of view, andwhere media content from each camera is provided to different users. Inone or more embodiments, the moveable cameras can be adjusted based ondetected motion of the user viewing the media content.

In one or more embodiments, the 3D content can be generated by a remoteserver and/or can be generated by media processors, such as through useof a depth map. In one or more embodiments, images of a user can berotated or otherwise repositioned during presentation in response todetecting speech of the user to further enhance telepresence bysimulating the user facing another user to speak. Other embodiments arealso can included.

One embodiment of the present disclosure can include a server thatincludes a memory and a controller coupled to the memory. The controllercan be adapted to receive a first request for a first telepresence seatat an event where the first request is associated with a first processorat a first location of a first user and to receive a second request fora second telepresence seat at the event where the second request isassociated with a second processor at a second location of a seconduser. The controller can be adapted to obtain media content comprisingevent images of the event that are captured by an event camera systemand to receive first images that are captured by a first camera systemat the first location. The controller can be adapted to receive secondimages that are captured by a second camera system at the secondlocation. In response to the first request, the controller can providethe media content and second video content representative of the secondimages to the first processor for presentation at a first display deviceutilizing a first telepresence configuration that simulates the firstand second users being present at the event. In response to the secondrequest, the controller can provide the media content and first videocontent representative of the first images to the second processor forpresentation at a second display device utilizing a second telepresenceconfiguration that simulates the first and second users being present atthe event. The providing of the first and second video content caninvolve establishing a communication session between the first andsecond users. The media content, the first video content and the secondvideo content can be adapted for presentation as three dimensionalcontent.

One embodiment of the present disclosure can include a method thatincludes receiving media content at a first media processor of a firstlocation associated with a first user, where the media content comprisesevent images of an event that are captured by an event camera system,and where the event camera system comprises a group of three dimensionalcameras. The media content can be received from a first threedimensional camera of the group of three dimensional cameras without thefirst media processor receiving other media content captured byremaining three dimensional cameras of the group of three dimensionalcameras. The method can include presenting the media content as threedimensional content at a first display device of the first location anddetecting a movement of the first user. In response to detecting themovement, a movement signal can be transmitted to the first threedimensional camera for moving the first three dimensional camera toadjust a viewing field of the first three dimensional camera.

One embodiment of the present disclosure can include a non-transitorycomputer-readable storage medium that includes computer instructions.The instructions can enable obtaining media content at a server, wherethe media content comprises event images of an event that are capturedby an event camera system, and where the event camera system comprises agroup of three dimensional cameras. The computer instructions can enabledetermining position information for each camera of the group of threedimensional cameras relative to the event and determining operationalinformation for each camera of the group of three dimensional cameras.The operational information can include movement capability to adjust aviewing field. The computer instructions can enable presenting an offerfor access to the media content to at least one consumer, where a priceassociated with the offer is based on the position and operationalinformation.

FIG. 1 depicts an illustrative embodiment of a first communicationsystem 100 for delivering media content, which can include 3D mediacontent. System 100 provides a user with media content of an event thatsimulates the user being present at the event. The media content can bepresented as 3D or holographic content. The media content can becaptured by fixed cameras (e.g., 3D cameras) at the event and users canshare the media content captured by the fixed cameras. The media contentcan also be captured by a group of cameras (e.g., 3D cameras) at theevent where the group of cameras is moveable for adjusting the field ofview, and where media content from each camera is provided to differentusers.

The communication system 100 can represent an Internet ProtocolTelevision (IPTV) broadcast media system although other media broadcastsystems can be used with the present disclosure. The IPTV media systemcan include a super head-end office (SHO) 110 with at least one superheadend office server (SHS) 111 which receives media content fromsatellite and/or terrestrial communication systems. In the presentcontext, media content can represent audio content, moving image contentsuch as videos, still image content, or combinations thereof. The SHSserver 111 can forward packets associated with the media content tovideo head-end servers (VHS) 114 via a network of video head-end offices(VHO) 112 according to a common multicast communication protocol.

The VHS 114 can distribute multimedia broadcast programs via an accessnetwork 118 to commercial and/or residential buildings 102 housing agateway 104 (such as a residential or commercial gateway). The accessnetwork 118 can represent a group of digital subscriber line accessmultiplexers (DSLAMs) located in a central office or a service areainterface that provide broadband services over optical links or coppertwisted pairs 119 to buildings 102. The gateway 104 can use commoncommunication technology to distribute broadcast signals to mediaprocessors 106 such as computers, Set-Top Boxes (STBs) or gamingconsoles which in turn present broadcast channels to display devices 108such as television sets or holographic display devices, managed in someinstances by a media controller 107 (such as an infrared or RF remotecontrol, gaming controller, etc.).

The gateway 104, the media processors 106, and/or the display devices108 can utilize tethered interface technologies (such as coaxial, phoneline, or powerline wiring) or can operate over a common wireless accessprotocol such as Wireless Fidelity (WiFi). With these interfaces,unicast communications can be invoked between the media processors 106and subsystems of the IPTV media system for services such asvideo-on-demand (VoD), browsing an electronic programming guide (EPG),or other infrastructure services.

Some of the network elements of the IPTV media system can be coupled toone or more computing devices 130, where a portion of these computingdevices can operate as a web server for providing portal services overan Internet Service Provider (ISP) network 132 to media processors 106,wireline display devices 108 or wireless communication devices 116(e.g., cellular phone, laptop computer, etc.) by way of a wirelessaccess base station 117 operating according to common wireless accessprotocols such as WiFi, or cellular communication technologies (such asGSM, CDMA, UMTS, WiMAX, Software Defined Radio or SDR, and so on).

A satellite broadcast television system can be used in conjunction with,or in place of, the IPTV media system. In this embodiment, signalstransmitted by a satellite 115 carrying media content can be interceptedby a common satellite dish receiver 131 coupled to the building 102.Modulated signals intercepted by the satellite dish receiver 131 can betransferred to the media processors 106 for decoding and distributingbroadcast channels to the display devices 108. The media processors 106can be equipped with a broadband port to the IP network 132 to enableservices such as VoD and EPG described above.

In yet another embodiment, an analog or digital broadcast distributionsystem such as cable TV system 133 can be used in place of or inconjunction with the IPTV media system described above. In thisembodiment the cable TV system 133 can provide Internet, telephony, andinteractive media services.

The present disclosure can apply to any present or next generationover-the-air and/or landline media content services system. In oneembodiment, an IP Multimedia Subsystem (IMS) network architecture can beutilized to facilitate the combined services of circuit-switched andpacket-switched systems in delivering the media content to one or moreviewers.

System 100 can provide 3D content to the building 102 for presentationand/or can provide 2D content that can be rendered into 3D content byone or more client devices, such as the media processor 106 or the TV108. The 3D image content can be based upon various 3D imagingtechniques, including polarization, anaglyphics, active shuttering (suchas alternate frame sequencing), autostereoscopy, and so forth. Thepresent disclosure can include presentation of all or a portion of adisplay in 3D, including utilizing devices that do not require awearable viewing apparatus (e.g., does not require active shutteringglasses).

In one embodiment, system 100 can include one or more image capturingdevices 175 (e.g. a camera) that can capture 2D and/or 3D images of auser and/or other objects at the building 102. Other components can beutilized in combination with or in place of the camera 175, such as ascanner (e.g., a laser system that detects object circumference),distance detector, and so forth. In one embodiment, camera 175 can be agroup of cameras, such as two or more cameras for providing differentviewing angles and/or for providing a holographic image. In oneembodiment, the camera 175 can capture images in 2D which are processedinto 3D content, such as by media processor 106 and/or computing device130. In one embodiment, depth maps can be utilized to generate 3Dcontent from 2D images. In another embodiment, the camera 175 can be astereoscopic camera that directly captures 3D images, such as throughuse of multiple lenses. A collector 176 or other component canfacilitate the processing and/or transmission of the captured images.The collector 176 can be a stand-alone device, such as in communicationwith the media processor 106 and/or the gateway 104 (e.g., wirelesslyand/or hardwired communication) or can be integrated with anotherdevice, such as the media processor 106.

Computing device 130 can also include computer readable storage medium180 having computer instructions for establishing a telepresencecommunication session with an event 10 and/or between client devices(e.g., media processor 106). The event 10 can be any type of occurrencethat can be recorded, such as a performance, a sporting event, a debate,and so forth. In one embodiment, the event 10 is an occurrence thatgathers an audience of live viewers, such as a football game or aconcert where tickets to attend the event are sold.

The computing device 130 can provide media content representative of theevent 10 to a number of different users at different locations, such asa user at building 102, via the telepresence communication session.Computing device 130 can provide the media content in a telepresenceconfiguration that simulates users being present at the event 10. Forinstance, the telepresence configuration can display an object 30 (e.g.a singer) of the media content and can further display each of the otherusers to simulate them being a part of the audience at the event 10. Inone embodiment, the particular telepresence configuration can beadjusted by one or more of the users based on user preferences, such asretrieved from a user profile or determined from monitored viewingbehavior.

The computing device 130 can be coupled with a camera system 25 that ispositioned at the event location to capture event images, such as in afield of view 90. The camera system 25 can include a number of differentcomponents, such as cameras 175, which can be three dimensional cameras,and which can be fixed and/or moveable cameras. In one embodiment,movement signals can be transmitted from the computing device 130 to acamera 175 of the camera system 25 to adjust the field of view 90. Inone embodiment, the movement signals can be generated in response toreceipt of control signals generated from detection of user movement atbuilding 102. For example, a user can move in a particular direction,rotation and so forth which results in one of the cameras 175 adjustingits field of view 90. The adjustment of the field of view 90 allows theuser to view various portions of the event 10, including at differentviewing angles.

In one or more embodiments, the storage medium 180 can include computerinstructions for determining a latency area of the access network 118and can configure routes for the telepresence session based on thelatency area, such as avoiding use of one or more network elements ofthe latency area. In one or more embodiments, the storage medium 180 caninclude computer instructions for determining a delay to inject orotherwise provide to the delivery and/or presentation of thetelepresence configuration to select locations in order to synchronizethe telepresence sessions among locations. For example, the computingdevice 130 can delay delivery of the video content and/or the mediacontent (e.g., a unicast or multicast of the media content) to a numberof locations so that those locations can be synchronized with anotherlocation that is experiencing latency.

In one or more embodiments, the media content and/or the images of theusers, or a portion thereof, can be presented as 3D content to enhancethe telepresence. For example, the 3D content can be generated bycomputing device 130 and/or can be generated by media processor 106,such as through use of a depth map in combination with the correspondingimages. System 100 can include other components to enhance thetelepresence experience. For instance, lighting and audio components canbe utilized to facilitate capturing the images and audio from a user.The lighting and/or audio components can be controlled by the mediaprocessor 106 and/or by the computing device 130. User preferencesand/or monitored behavior can be utilized in controlling the lightingand/or audio components.

In one embodiment, the users can be part of a social network and thecomputing device 130 can be in communication with a social networkapplication, such as for selecting the media content to be provided inthe telepresence configuration. In one embodiment, the telepresenceconfiguration, including providing the media content and the videocontent of each of the users, can be performed without using thecomputing device 130 to generate the video content from captured imagesor to combine the media and video content. In one example, thetelepresence configuration can be generated by the media processors 106and distributed through a peer-to-peer technique, where the mediaprocessors share the video content amongst themselves and obtain themedia content from one of the media processors or from another source,such as media content being broadcast. In one embodiment, each of themedia processors 106 of the different users can be in a master-slavearrangement to control presentation of the media content and facilitategenerating the telepresence configuration.

System 100 enables video and/or audio content of the users to beprovided to the other users in real-time to establish a communicationsession while simulating the co-location of the users at the event andproviding telepresence with the media content.

FIG. 2 depicts an illustrative embodiment of a presentation device 202and the media processor 106 for presenting a telepresence configuration210 that can include video content 225 which is captured images of usersthat are at different locations from where the presentation device 202is located. The users can be associated with each other, such as througha group purchase of access to the media content 250. A portion or all ofthe users can also be unrelated, similar to audience members who wouldattend the event 10.

The telepresence configuration 210 also includes the media content 250,such as captured from event 10 of FIG. 1. The telepresence configuration210 can simulate the users being present at the event 10 through use ofthe video content 225. The simulation can be performed in a number ofdifferent ways, including presenting the other users in the images as ifthey were viewing the media content 250. The simulation can befacilitated by the positioning of the camera 175 and/or by post-captureprocessing, such as adjusting the video content 225 so that the otherusers appear as being rotated towards the media content 250. Othersimulation effects can be utilized. For example, the images in the videocontent 225 can be re-sized, including based on the particular size ofthe presentation device 202, to further simulate the other users beingpresent at the location of the presentation device 202. The mediacontent 250 and/or video content 225 of one or more users can beprovided for presentation in the telepresence configuration 210 in 3D.

In one embodiment, the video content 225 comprises telepresence seats226 that are representative of the remote users that are receiving thetelepresence configurations 210 at the different locations. In thisexample, each of the telepresence seats or a portion thereof can have adifferent viewing angle of the object 30 at event 10 (FIG. 1) which isbeing presented in the media content 250. In one embodiment, thetelepresence seats 226 can be sold on an individual basis such that onlyone telepresence seat 226 is sold per person resulting in all of theusers at the different locations having different viewing angles of theobject 30.

In one embodiment, a viewing area 260 can be provided to the user sothat the media content 250 is more easily seen. The viewing area can bean area that is directly in front of the user if the user where actuallypresent at the event 10. In one embodiment, telepresence seats inviewing area 260 can be provided to other users (including providing themedia content 250 at the particular viewing angle) but thosetelepresence seats in the viewing area are removed or otherwise notpresented in the video content 225 so as not to obstruct the view of theuser.

In one embodiment, the user who has been assigned to telepresence seat226A is shown facing away from the object 30. This technique can beutilized for facilitating communication between users who are intelepresence seats 226 that are close to each other. For example, theuser at telepresence seat 226A may desire to speak with the userreceiving the telepresence configuration 210 in system 200. Speechdetection or other techniques can be utilized to initiate adjusting thevideo content 225 in this example.

One or both of the presentation device 202 and the media processor 106can include the camera 175 that captures images of the user that areprovided to the other users in their telepresence configuration 210. Thecamera 175 can capture 2D images and/or can capture 3D images. Thecamera 175 can be a group of cameras to capture multiple views,including views to construct a holographic image, such as of the userand/or of objects associated with the user. In one embodiment, thepresentation device 202 can be a holographic display device thatpresents all or a portion of the telepresence configuration 210 asholographic content. The holographic content can allow a viewer'sperspective on a depicted object to change as the viewer moves aroundthe hologram content, just as it would if the object were real.

In the present illustration, the presentation device 202 is depicted asa television set. It will be appreciated that the presentation device202 can represent a portable communication device such as a cellularphone, a PDA, a computer, or other computing device with the ability todisplay media content. The media processor 106 can be an STB, or someother computing device such as a cellular phone, computer, gamingconsole, or other device that can process and direct the presentationdevice 202 to present images associated with media content 250 and/orthe video content 225. It is further noted that the media processor 106and the presentation device 202 can be an integral unit. For example, acomputer or cellular phone having computing and display resourcescollectively can represent the combination of a presentation device 202and media processor 106.

The media processor 106 can be adapted to communicate with accessoriessuch as the viewing apparatus 300 of FIG. 3 by way of a wired orwireless interface, such as through RF and/or light waves 206. Thecommunication can be one-way and/or two-way communication, such asproviding the viewing apparatus 300 with a transceiver 302. A wiredinterface can represent a tethered connection from the viewing apparatus300 to an interface of the media processor (e.g., USB or proprietaryinterface). A wireless interface can represent a radio frequency (RF)interface such as Bluetooth, WiFi, Zigbee or other wireless standard.The wireless interface can also represent an infrared communicationinterface. Any standard or proprietary wireless interface between themedia processor 106 and the viewing apparatus 300 can be used by thepresented disclosure.

The viewing apparatus 300 can represent an apparatus for viewingtwo-dimensional and/or 3D stereoscopic images which can be still ormoving images. The viewing apparatus 300 can be an active shutterviewing apparatus. In this embodiment, each lens has a liquid crystallayer which can be darkened or made to be transparent by the applicationof one or more bias voltages. Each lens 304, 306 can be independentlycontrolled. Accordingly, the darkening of the lenses can alternate, orcan be controlled to operate simultaneously.

Each viewing apparatus 300 can include various components associatedwith a communication device including a wireline and/or wirelesstransceiver 302 (herein transceiver 302), a user interface (UI), a powersupply, a location detector, and a controller 307 for managingoperations thereof. The transceiver 302 can support short-range orlong-range wireless access technologies such as infrared, Bluetooth,WiFi, Digital Enhanced Cordless Telecommunications (DECT), or cellularcommunication technologies, just to mention a few. Cellular technologiescan include, for example, CDMA-1×, UMTS/HSDPA, GSM/GPRS, TDMA/EDGE,EV/DO, WiMAX, SDR, and next generation cellular wireless communicationtechnologies as they arise. The transceiver 302 can also be adapted tosupport circuit-switched wireline access technologies (such as PSTN),packet-switched wireline access technologies (such as TCPIP, VoIP,etc.), and combinations thereof.

The UI can include a depressible or touch-sensitive keypad with anavigation mechanism such as a roller ball, joystick, mouse, ornavigation disk for manipulating operations of the communication device300. The keypad can be an integral part of a housing assembly of theapparatus 300 or an independent device operably coupled thereto by atethered wireline interface (such as a USB cable) or a wirelessinterface supporting for example Bluetooth. The keypad can represent anumeric dialing keypad commonly used by phones, and/or a Qwerty keypadwith alphanumeric keys. The UI can further include a display such asmonochrome or color LCD (Liquid Crystal Display), OLED (Organic LightEmitting Diode) or other suitable display technology for conveyingimages to an end user of the apparatus 300. In an embodiment where thedisplay is touch-sensitive, a portion or all of the keypad 308 can bepresented by way of the display.

The UI can also include an audio system 312 that utilizes common audiotechnology for conveying low volume audio (such as audio heard only inthe proximity of a human ear) and high volume audio for hands freeoperation. The audio system 312 can further include a microphone forreceiving audible signals of an end user. The audio system 312 can alsobe used for voice recognition applications. The UI can further includean image sensor such as a charged coupled device (CCD) camera forcapturing still or moving images.

The power supply can utilize common power management technologies suchas replaceable and rechargeable batteries, supply regulationtechnologies, and charging system technologies for supplying energy tothe components of the apparatus 300 to facilitate long-range orshort-range portable applications. The location detector can utilizecommon location technology such as a global positioning system (GPS)receiver for identifying a location of the communication device 300based on signals generated by a constellation of GPS satellites, therebyfacilitating common location services such as navigation.

The transceiver 302 can also determine a proximity to a cellular, WiFior Bluetooth access point by common power sensing techniques such asutilizing a received signal strength indicator (RSSI) and/or a signaltime of arrival (TOA) or time of flight (TOF). The controller 306 canutilize computing technologies such as a microprocessor, a digitalsignal processor (DSP), and/or a video processor with associated storagememory such a Flash, ROM, RAM, SRAM, DRAM or other storage technologies.

In one embodiment, the viewing apparatus 300 can utilize a receiverportion of the transceiver 302 in the form of an infrared.Alternatively, the viewing apparatus 300 can function as a two-waycommunication device, in which case a full infrared transceiver could beutilize to exchange signals between the media processor 106 and theviewing apparatus 300.

The viewing apparatus 300 can utilize a controller 307 to controloperations thereof, and a portable power supply (not shown). The viewingapparatus 300 can have portions of a UI. For example, the viewingapparatus 300 can have a multi-purpose button 312 which can function asa power on/off button and as a channel selection button. A power on/offfeature can be implemented by a long-duration depression of button 312which can toggle from an on state to an off state and vice-versa. Fastdepressions of button 312 can be used for channel navigation.Alternatively, two buttons can be added to the viewing apparatus 300 forup/down channel selection, which operate independent of the on/off powerbutton 312. In another embodiment, a thumbwheel can be used forscrolling between channels.

The viewing apparatus 300 can also include an audio system 313 with oneor more speakers in the extensions of the housing assembly such as shownby references 314, 316 to produce localized audio 318, 320 near a user'sears. Different portions of the housing assembly can be used to producemono, stereo, or surround sound effects. Ear cups (not shown) such asthose used in headphones can be used by the viewing apparatus 300 (as anaccessory or integral component) for a more direct and low-noise audiopresentation technique. The volume of sound presented by the speakers314, 316 can be controlled by a thumbwheel 310 (or up/down buttons—notshown).

It would be evident from the above descriptions that many embodiments ofthe viewing apparatus 300 are possible, all of which can be used withthe present disclosure. In one embodiment, the viewing apparatus 300 canbe utilized as part of the image capture process. For instance, thetransceiver 302 can function to transmit a locator and/or calibrationrequest that is wirelessly emitted for receipt by the camera(s) 175 oranother processing device, such as the media processor 106. The emittedsignal can be position information that is utilized to facilitatecapturing images of a target, including adjusting the positioning andfocus of the camera(s) 175 to capture the user and/or another object. Inone embodiment, the viewing apparatus 300 can be used to detect movementof the user for generating commands to control movement of a camera 175at the event 10 (e.g., three dimensional cameras of camera system 25) inorder to adjust the field of view of the camera at the event.

In one embodiment, the presentation device 202 can present holographiccontent that enables different perspectives of a user and/or object tobe viewed depending on the position of the viewer. The holographiccontent can be all or a portion of the telepresence configuration 210,such as only the media content 250 or only one or more of the videocontent 225. As an example, the presentation device 202 can utilizeactive shuttering where different perspectives of an image are presentedduring different time slots which can be synchronized with the viewingapparatus 300. The particular perspective of an image can be viewed viathe active shuttering of the viewing apparatus 300 based on the positionof the viewer, such as detected from the viewing apparatus. An exampleof this is described in U.S. application Ser. No. 12/839,943 filed onJul. 20, 2010, the disclosure of which is hereby incorporated byreference in its entirety. Other techniques and components are can beused for presenting holographic content at the presentation device 202,including with or without a viewing apparatus 300.

In one embodiment, the images of the user(s) in video content 225 can bemodified, including change of clothing, environment and/or appearance.For example, the images of the other users can be presented but withoutthe viewing apparatus 300 being worn. For instance, other images of theother users, such as in user profiles, can be utilized to modify theimages to fill in pixels where the viewing apparatus 300 was removed. Inanother example, the modification of the images of the video content 225can be based on the media content 250, such as the images of the otherusers being presented but wearing a cowboy hat where the media contentis a rodeo. The modifications to the video content 225 can be based on anumber of different factors, such as user preferences, and can becontrolled by various entities, such as allowing a user to retaincontrol over any modifications to the presentation of their own imagesand/or allowing a user to control any modification to the presentationof other users.

FIG. 4 depicts an illustrative embodiment of a presentation device 402with a polarized display. A display can be polarized with polarizationfilter technology so that alternative horizontal pixel rows can be madeto have differing polarizations. For instance, odd horizontal pixels 402can be polarized for viewing with one polarization filter, while evenhorizontal pixels 404 can be polarized for viewing with an alternativepolarization filter. The viewing apparatus 300 previously described canbe adapted to have one lens polarized for odd pixel rows, while theother lens is polarized for viewing even pixel rows. With polarizedlenses, the viewing apparatus 300 can present a user a 3D stereoscopicimage. The telepresence configuration 210 of FIG. 2 can be presentedutilizing the presentation device 402.

System 400 illustrates use of multiple cameras 175 for capturing imagesof user 420 from different perspectives or views. The differentperspective images can then be utilized for generating a 3Drepresentation of the user 420. The particular number and positioning ofthe cameras 175 can vary. In one embodiment, one of the cameras 175 canbe a depth or distance camera that is utilized for generating a depthmap associated with the user 420 so that the depth map and imagescaptured by the other cameras can be used in constructing the 3Drepresentation of the user 420.

FIG. 5 depicts an illustrative embodiment of a communication system 500that can provide the telepresence configuration 210 to a plurality oflocations 102, 502 and 503. While three locations are illustrated insystem 500, the present disclosure can have two or more locations beingutilized. The telepresence configuration 210 for each of the locations102, 502 and 503 includes the media content 250 and includes videocontent 225 for the other users. For example, a user 520 at location 102is provided with video content 225 that includes other users 525, 525Aat locations 502 and 503, as well as a number of other users at otherlocations (not shown) arranged in audience seating.

The computing device 130 can be utilized to provide the telepresenceconfiguration 210 to each of the locations 102, 502, 503, such asthrough receiving captured images of each of the users 520, 525 and525A, and distributing the video content 225 and the media content 250to each of the locations. As an example, each of the media processors106 can then present the video content 225 and the media content 250,such as simulating the users being in seats in the audience. Theparticular configuration can depend on the venue of the event 10. Forexample, if the venue is a small theatre for a concert then a limitednumber of rows can be provided at eye level with the object 30 where asif the venue is a stadium for a football game then rows of seats can bepresented that look down at the playing field.

In one embodiment, the captured images and the media content 250 can becombined by the computing device 130 into single content that isprovided to the locations 102, 502 and 503, such as through a multicast,without the need for further arranging the media and video content. Inone embodiment, separate or a combined stream of the media content 250and the video content(s) 225 can be provided to each media processor 106for combining into the telepresence configuration 210.

In one embodiment, the media processor 106 can instruct the users 520,525 and 525A to sit or otherwise position themselves where they will bewatching the telepresence configuration 210. A position of the user canthen be determined for adjusting the camera 175 at each of the locations102, 502, 503. A distance to the viewer can be determined, such asthrough use of time-of-flight, stereo triangulation, sheet of lighttriangulation, structured light, interferometry, coded aperture, and soforth. Other components can also be utilized to facilitate the process,including a depth camera integrated with camera 175 or provided as astand-alone component.

System 500 can utilize a camera system 575 at event 10 to capture theimages of object 30 that are presented in media content 250. Camerasystem 575 can include a number of fixed cameras 175, such as threedimensional cameras. In one embodiment, images captured by the cameras175 can provide different perspectives or viewing angles of the object30. System 500 allows multiple users to share images from the samecamera or cameras. Users can be provided with different viewing anglesand/or can share the same viewing angle of the object 30. The particularnumber and configuration of the cameras 175 of camera system 575 canvary based on a number of factors, including the venue of the event 10.As an example, in a theatre with lower and upper seating, the camerascan be arranged between the upper and lower levels. As another example,the cameras 175 of the camera system 575 at a stadium can be arranged asa camera bank in front of stadium seating, but so as not to obstruct theview of the stadium seating.

In this example, user 525A at location 503 is speaking with user 520 atlocation 102. To facilitate the communication, a portion 225A of thevideo content can be adjusted so that user 525A presented atpresentation device 202 of location 102 is turned to face the user 520at the location 102. In one embodiment, user 520 can mute or otherwiseprevent the other users in the video content 225 from communicating withhim or her, such as preventing the exchange of audio signals and/orpreventing user 525A from facing user 520 in the video content 225. Themuting can be performed remotely by the computing device 130 and/or canbe performed locally by the media processor 106 of location 102. Themuting can be performed selectively, such as user 520 designatingparticular users that are to be muted and allowing others to communicatewith user 520. The muting can also be performed while allowing thepresentation of the media content 250, including video and audio, tocontinue.

FIG. 6 depicts an illustrative embodiment of another communicationsystem 600 that can present the telepresence configuration 210 atdisplay devices 108 of different users at different locations via atelepresence communication session. System 600 can be overlaid oroperably coupled with the devices and systems of FIGS. 1-5 to receivemedia content 250 and/or video content 225, which is presentable as 3Dcontent. In one embodiment, computing device 130 can receive 2D mediacontent from the cameras 175 at event 10 and can generate (or otherwiseobtain) a depth map associated with the media content, such as based onobject segmentation. The computing device 130 can encode the mediacontent and depth map (such as into a single video stream in H.264format encapsulated in an MPEG-2 wrapper) and transmit the media contentand depth map to one or more media processors 106, such as throughbroadcast, multicast and/or unicast utilizing network 625. In oneembodiment, the computing device 130 can generate the depth map inreal-time or near real-time upon receipt of the 2D media content, suchas from a broadcast studio. The computing device 130 can also generate adepth map for video content that is captured by the cameras 175 in 2D.

System 600 includes media processors 106 which receive the video streamof the 2D media and video content and the corresponding depth maps. Themedia processors 106 can generate 3D content using the depth maps inreal time upon receipt of the video stream. The media processors 106 canalso detect the capability of display devices (such as through HDMI1.4a) and can adjust the media content accordingly. For instance, if adisplay device 108 can only present 2D content, then the media processor106 may discard the depth map and provide the 2D content to the displaydevice. Otherwise, the media processor 106 can perform the real-timegeneration of the 3D content using the depth map and provide the contentto the 3D capable display device 108. The conversion into 3D contentfrom the depth map(s) can be based upon various imaging techniques andthe 3D presentation in the telepresence configuration 210 can be basedupon various formats including polarization, anaglyphics, activeshuttering (such as alternate frame sequencing), autostereoscopy, and soforth.

In one embodiment, position information associated with one or moreviewers can be utilized to adjust 3D media content, such as adjusting aconvergence of the media content 250 and/or video content 225 based on adistance of the viewer(s) from the display device 108. Calibration canalso be performed using a number of components and/or techniques,including a distance camera to measure distances and/or image camera 175for capturing images of the viewers which can be used for interpolatingdistances.

System 600 has the flexibility to selectively provide 2D content and 3Dcontent to different locations. System 600 further has the flexibilityto selectively provide a combination of 2D and 3D content forpresentation in the telepresence configuration 210 (FIG. 2). Forexample, a user may desire to watch the media content 250 in 3D whileviewing the video content 225 in 2D. The selection of 2D or 3Dpresentation can be based on a number of factors, including devicecapability and type of content. The selection can be made by a number ofdifferent entities, including the users via the media processors 106and/or by the service provider via computing device 130. The selectionof 2D or 3D can also be made by one or more devices of system 600without user intervention based on a number of factors, such as devicecapability, network status, viewing history, and so forth.

FIG. 7 depicts an illustrative embodiment of another communicationsystem 700 that can present a telepresence configuration 210 atpresentation devices 202 of different users at different locations 102,502, 503 via a telepresence communication session. System 700 can beoverlaid or operably coupled with the devices and systems of FIGS. 1-6to receive media content and/or video content which is presentable as 2Dcontent, and/or 3D or holographic content. System 700 can includecomponents similar to that of system 600, such as the media processor106, the presentation device 202, the computing device 130 and thecameras 175. The presentation device can be various types of displaydevices including televisions, holographic display devices, volumetricdisplay devices, and so forth.

While three locations are illustrated in system 700, the presentdisclosure can have two or more locations being utilized. Thetelepresence configuration 210 for each of the locations 102, 502 and503 can include media content 250 and can include video content 225. Forexample, a user 520 at location 102 can be provided with video content225 that includes users 525, 525A at locations 502, 503, as well asother users at other locations (not shown) that are accessing the mediacontent. The computing device 130 can be utilized to provide thetelepresence 210 to each of the locations 102, 502, 503, such as throughreceiving captured images of each of the users 520, 525 and 525A anddistributing the video content 225 and the media content 250 to each ofthe locations. As an example, each of the media processors 106 can thenpresent the video content 225 and the media content 250, such as in anarrangement simulating the users 520, 525 and 525A being present at theevent 10, which can include positioning the video content 225 as if theusers 525, 525A were sitting in the audience at the event 10 viewing themedia content 250. To facilitate the communication, a portion 225A ofthe video content can be adjusted so that user 525A presented atpresentation device 202 of location 102 is turned to face the user 520at the location 102.

In one embodiment, the captured images of the users (e.g., video content225) and the media content 250 can be combined by the computing device130 into single content that is provided to the locations 102, 502 and503, such as through a multicast, without the need for further arrangingthe object and video content. In one embodiment, separate or a combinedstream of the media content 250 and the video content(s) 225 can beprovided to each media processor 106 for combining into the telepresenceconfiguration 210.

The media content 250 can be generated based on images captured by acamera system 775 that includes a group of cameras 175 that are moveableor otherwise adjustable to change the viewing field of each of thecameras. The group of cameras 175 can be positioned to capture differentviewing angles for the object 30 which in this example is footballplayers in a football game (i.e., event 10). The images can then beprocessed into the media content 250 by generating 3D images from 2Dimages for the object 30 and/or capturing 3D images using 3Dstereoscopic cameras. Various 3D techniques and components can beutilized, including polarization, anaglyphics, active shuttering (suchas alternate frame sequencing), autostereoscopy, and so forth.

In one embodiment, one or more of the cameras 175 can be independentlycontrolled with respect to the other cameras of camera system 775. Forexample, camera 175A and camera 175B can each be 3D cameras that capture3D images. Camera 175A and camera 175B can be controlled independentlyof each other and independently of the remaining cameras of camerasystem 775. Camera 175A can be moved or otherwise adjusted so that itsviewing field focuses on quarterback 30 of the object 30. Camera 175Acan capture images that are used for generating media content 250A thatis provided to user 520 at location 102. Camera 175B can be moved orotherwise adjusted so that its viewing field focuses on receiver 30B ofthe object 30. Camera 175B can capture images that are used forgenerating media content 250B that is provided to user 525 at location502. Both media receivers 106 at locations 102, 502 receive mediacontent captured from event 10, but the users are provided theflexibility to view different portions of the object 30, similar to theexperience of an individual who is in the stadium watching the footballgame.

The movement or adjustment of the viewing field for the cameras 175 canbe performed in a number of different ways based on a number ofdifferent techniques. In one embodiment, movement of a user can bedetected and the camera 175 can be adjusted based on the detectedmovement. For instance, if it is detected that a user rotates his or herhead to the right then the viewing filed can be shifted to the right. Inone embodiment, the change in the viewing field can be performed basedon relative movement. For example, a rotation of the user's head from acentered position to a right-facing position can cause the viewing fieldto shift to the right and allow portions of the object 30 (e.g.,receivers 30B) to appear in the center of the media content 250.Rotation of the user's head back to the centered position can bedetected as the user focuses on the receivers 30B that are beingpresented, but this movement may not cause the viewing field to beadjusted. If the user rotates his or head from the centered position toa left-facing position then the viewing field can be adjusted to shiftto the left which allows portions of the object 30 (e.g., quarterback30A) to appear in the center of the media content 250. Rotation of theuser's head back to the centered position can be detected as the userfocuses on the quarterback 30A that are being presented, but thismovement may not cause the viewing field to be adjusted.

Other methods for adjusting the viewing field can be used by the presentdisclosure. For example, gestures of the user can be detected (e.g.,hand motion) and the viewing field of camera 175 can be adjusted basedon the particular gesture. The re-positioning of the cameras 175 can beperformed in a number of different ways, such as pivoting cameras,sliding cameras on a track (e.g., a circular or annular track), and soforth. In one embodiment, the re-positioning of the cameras 175 can beperformed automatically based on actuation of motors (e.g., electricservo-motors) coupled with the cameras that can adjust the position ofthe camera.

Various methods and components can be utilized for detecting usermovement. In one embodiment, apparatus 300 of FIG. 3 can be used todetect user movement, such as head rotation via communication betweenthe apparatus 300 and the media processor 106 or a separate motiondetection device. Image recognition, user illumination with a lightsource, determination of light travel distance associated with the user,generating a depth map for the user and other techniques can also beused. Gyroscopes, accelerometers and other position detection devices,such as in the apparatus 300, can also be utilized for detectingmovement of the user. The present disclosure can include detecting usermovement with or without the apparatus 300, such as based on apositioned detector embedded in the media processor 106 or a separatedevice coupled with the media processor that can detect user movement,including through illuminating the user with a light source.

Control signals or commands can be generated, such as by the mediaprocessor 106, based on the detected movement. The control signals canbe transmitted to the computing device 130 and/or directly to thecorresponding camera of camera system 775 for moving the camera toadjust its viewing field. In one embodiment, the control signals can bereceived by the computing device from the media processor 106. Thecomputing device 130 can generate a motion signal or command which isprovided to the camera system 775 to initiate the camera adjustment. Thecomputing device 130 can analyze the received control signal todetermine if the camera is capable of the particular motion and/or todetermine if the control signal is a legitimate signal for adjusting thecamera. For example, if the detected movement is a 90 degree rotation ofthe user's head which would mean the user was not viewing his or herpresentation device then the computing device 130 can determine that thecamera should not be adjusted. The computing device can use varioustechniques for determining legitimate control signals, such as based onmovement thresholds, movement speed, and/or monitored movement of theuser (e.g., stored in a user profile). The computing device 130 can alsoprovide a translation to detected movement in the control signal. Forinstance, the detected movement can be a 30 degree rotation of theuser's head which the computing device 130 can translate into aproportional angular adjustment (e.g. 45 degrees) of the viewing fielddue to the potential viewing area of the event 10.

In one embodiment, media content 250 generated from the images capturedby each camera 175 of the camera system 775 can be separately providedto different user so that there is no sharing of images from the camerasystem 775 between the users. In this example, users can purchase atelepresence seat 226 which has a camera (e.g., camera 175A) assignedfor the telepresence seat. Only the user who purchased that telepresenceseat 226 will have access to the media content 250 that is generatedfrom the images captured by the particular camera 175. The user willfurther have the flexibility of manipulating the viewing field of thecamera 175.

In one embodiment, the generated media content 250 is 3D content that isholographic content. The holographic content provides different viewingperspectives of the object 30 based on viewer position in reference to adisplay device. The media content 250 can be generated in whole or inpart by various devices in system 700, such as computing device 130and/or media processor 106. In one embodiment, the selection of a deviceto perform the generation of the media content 250 or a portion thereofcan be based on load-balancing. For instance, local devices such asmedia processor 106 of location 503 can generate all or a portion of themedia content 250 when a desired amount of processing resources areavailable for the local media processor 106. However, if a desiredamount of processing resources are not available for the local mediaprocessor 106 at location 503 then other devices, such as one or more ofthe other media processors at locations 102 and 502 and the computingdevice 130 can generate the media content 250.

In one embodiment, a plurality of formats can be generated for the mediacontent 250. The different formats can be based on the capabilities ofthe media processors 106 and/or the presentation devices 202. Forinstance, holographic content may be generated for the media processor106 if it is determined that the presentation device 202 at location 102is a holographic display device or otherwise has the ability to presentholographic images, while 3D content based on active shuttering can begenerated for the media processor 106 of location 502 if it isdetermined that capabilities at location 502 warrant this format. In oneembodiment, the selection and generation of the format of the mediacontent 250 can be based on capability determinations being made by thedevices of system 700, such as the computing device 130 querying thelocal devices for display capabilities and/or accessing user profiles orpast history information to make the determination. In one embodiment,each of the various formats can be generated without regard to devicecapabilities and a selection can then be made of the correspondingformat to be transmitted.

FIG. 8 depicts an illustrative embodiment of a method 800 operating inportions of the devices and systems described herein and/or illustratedin FIGS. 1-7. Method 800 can begin with step 801 in which a request forevent telepresence seating is received. The request can be received in anumber of different ways, such as through a social network applicationor in response to an offer for a telepresence seat. The offer can bemade at anytime, including after seats at the event are no longeravailable. In one embodiment, the price associated with the offer can bebased on various factors. For example, position information relative tothe event can be determined for each camera used to capture images ofthe event. Operational information for each camera can be determinedsuch as whether the camera is a fixed camera or is capable Of adjustingits viewing field (e.g., a moveable camera). The offer for telepresenceseating for the event can be based on the position and/or operationalinformation.

At step 802 the media content 250 can be obtained, such as throughtransmission over a network from a camera system at the event. The mediacontent 250 can be received as 2D content and converted to 3D contentand/or can be received as 3D content. The media content 250 can bereceived by the computing device 130 (e.g., a centralized distributionprocess) and/or received by one or more of the media processors 106(e.g., a distributed or master-slave process). It should be understoodthat the present disclosure can include the media processor 106 beingvarious types of devices, including personal computers, set top boxes,smart phones and so forth. The media content 250 can be generated fromcameras, such as 3D cameras, where the images are shared among two ormore users (e.g., fixed cameras at the event) or where there is nosharing of images, such as where a user has purchased a telepresenceseat that is associated with a camera that has an adjustable viewingfield. Combinations of fixed and adjustable cameras can also be utilizedso that a portion of the users are sharing some images while anotherportion of the users are not sharing their images.

At step 803, it can be determined if the event includes group seating,such as in an audience and whether other users have obtained access tothe media content 250 and thus have a telepresence seat at the event. Ifthere is group seating then at step 804, video content 225 can bereceived from a plurality of different media receivers 106 at differentlocations. The video content 225 can be received as part of acommunication session established between media processors 106 of eachof the different users. Each of the video content 225 can be received as2D content and converted to 3D content and/or can be received as 3Dcontent. Each of the video content 225 can be received by the computingdevice 130 (e.g., a centralized distribution process) and/or received byone or more of the media processors 106 (e.g., a distributed ormaster-slave process). The video content 225 can be captured by one ormore cameras 175 at each location, where the cameras are 2D and/or 3Dcameras. Other components can also be used to facilitate capturing thevideo content 225, including lighting components and/or audiocomponents, which can be controlled locally and/or remotely (e.g., bythe computing device 130 or a master media processor 106).

At step 806, it can be determined if 3D content has been requested or isotherwise desired. For instance, a user profile associated with eachuser at each location can be accessed by the computing device 130 and/orone or more of the media processors 106 to determine if 3D content isdesired for the media content 250 and/or video content 225. If 3Dcontent is desired then at step 808 the content can be processedaccordingly. For example, if the content received is in 3D format, suchas from a 3D content at the event or at a user location, then adetermination can be made if the format is compatible with the mediaprocessors 106 and adjusted accordingly. For instance, content can beadjusted to be compatible with a first media processor 106 and a copy ofthe content can be further adjusted to be compatible with a second mediaprocessor. If the content is in 2D format then the content can beconverted to 3D format, such as through use of a depth map or usingother techniques.

At step 810, the media content 250 and the video content 225 can bepresented at each display device of each location in a telepresenceconfiguration, such as configuration 210 of FIG. 2 and/or FIG. 7. Thetelepresence configuration can simulate each of the users beingco-located at the event. In one embodiment, the telepresenceconfigurations can be adjustable, such as by the user selecting theconfiguration. The adjustments to the telepresence configuration caninclude size, resolution, and so forth.

In one embodiment at step 812, the computing device 130 and/or the mediaprocessor 106 can monitor to detect speech of a user at one of thelocations. If speech is detected from a target user, then at step 814the video content can be adjusted (e.g., by the computing device 130and/or the media processor 106) to further simulate the target userspeaking to the one or more of the other users, such as an adjacent userin the telepresence seating. This simulation can include depicting thetarget user or a portion thereof (e.g., the user's head) turning to facethe viewer of the display device to speak with them. In one embodiment,the telepresence configuration can provide images of the rear of theother user's head's as if they were watching the media content and thenpresent the face of the target user when the target user is speaking. Inone embodiment, images of a front of a user's head can be used togenerate video content depicting the back of the user's head, such asthrough determining shape, circumference, hair color and so forth.

In one embodiment, a user can select other users to be muted or withwhom communication is to be permitted. The muting can be performed in anumber of different ways and by different components, including thecomputing device 130 and/or the media processors 106. For example, themuting can be performed by preventing audio signals from a “speaking”user to be presented at a user's location who has muted the other user.The muting can be performed while allowing the media content 250 tocontinue to be presented both through video and audio.

In one embodiment at step 816, user interaction (including usermovement) can be detected or otherwise determined, such as by one of themedia processors 106 and/or the computing device 130. The userinteraction can be based on detected movement of the user, includingrotation of the user's head. The user interaction can also be based onuser inputs at a user interface at one of the locations. At step 818,the media content 250 can be adjusted in response to the userinteraction. The adjustment can be performed in a number of differentways, including based on utilizing different images with differentviewing angles, adjusting the cameras 175 of camera system 775 toprovide for different perspective or viewing field, and/or extrapolatingviews based on the captured images.

FIG. 9 depicts an illustrative embodiment of another communicationsystem 900 that can present a telepresence configuration 910 atpresentation devices 108 of different users at different locations 902,903, 904 via a telepresence communication session. System 900 can beoverlaid or operably coupled with the devices, systems and methods ofFIGS. 1-8 to receive media content and/or video content in thetelepresence configuration 910. The media content and/or video content(e.g., media content 250 and video content 225 of FIG. 2) can bepresented as 3D or holographic content. System 900 can includecomponents similar to that of system 600, such as the media processor106, the computing device 130 and the cameras 175. The presentationdevices 108 can be various types of display devices includingtelevisions, holographic display devices, volumetric display devices,and so forth. The cameras 175 can be various types of devices, including2D and 3D cameras and can be any number and configuration of cameras,including system 775 of FIG. 7. While three locations are illustrated insystem 900, the present disclosure can include two or more locationsbeing utilized.

The media processors 106 of the locations 902, 903, 904 can communicatewith each other and/or with the computing device 130 over a network 950that includes network elements 955. The network elements 955 can bevarious devices utilized for providing communication, including routers,switches, servers, DSLAMs, and so forth. The number and configuration ofthe network elements 955 can vary. A multimedia source 960, such ascamera system 775 a the event 10 of FIG. 7 can be utilized for sourcingthe media content to the media processors 106 of the locations 902, 903,904, including via the computing device 130.

System 900 can provide for latency testing to be performed with respectto the media processors 106 of the locations 902, 903, 904, as well aswith respect to the network elements 955 that could be used forproviding the telepresence sessions between these locations. The type oflatency testing performed can vary. For example, loopback testing can beperformed by the computing device 130 to each of the media processors106 of the locations 902, 903, 904 and/or to the source 960. Theloopback testing can also be originated from devices other than thecomputing device 130, such as from the media processors 106 of one ormore of the locations 902, 903, 904 and/or from one or more networkelements 955, such as along a potential route of the telepresencesession. In one embodiment, multiple loopback tests can be originatedfrom multiple devices along potential routes of the telepresencesession. The results of this group of loopback tests can be utilized toisolate particular network elements 955 that are experiencing latency.

The use of other latency testing techniques can be used by the presentdisclosure for isolating network elements 955 experiencing latency,including periodically or otherwise gathering latency parametersassociated with all or a portion of the network elements 955 of thenetwork 950. The latency parameters can be analyzed for determiningparticular network elements 955 experiencing latency. It should beunderstood that the latency can be caused by various factors, includingworkload, faults, on-going maintenance, and so forth. In one or moreembodiments, the methodology and/or the components used to determinewhich network elements 955 of the network 950 are experiencing latencycan be selected based on a known or predicted cause of the latency.

In one embodiment, when one or more network elements 955 of the network950 are determined to be experiencing latency, then a latency area 980can be determined or otherwise defined for the network 950. The latencyarea 950 can be determined based on the isolated network elements 955experiencing the latency, as well as a known topology of the network950. For example, the latency area 980 of FIG. 9 depicts three networkelements 955A, 955B, 955C. In this example, network elements 955A and955C have been determined to be experiencing latency while no suchdetermination has been made with respect to network element 955B.However, the network element 955B has been included in the latency area980 because, based on the network topology, it has been determined thatrouting 985 between network element 955A and network element 955C wouldbe done through network element 955B.

In one or more embodiments, the routes for the telepresence session canbe configured or otherwise determined based on the latency area 980. Forexample, routes can be configured to avoid all or a portion of thenetwork elements 955 in the latency area 980. The configuration of theroutes can be performed by a number of different devices (e.g. thecomputing device 130) and can be performed in a centralized ordistributed fashion (e.g., using a group of computing devices 130positioned in different parts of the network 950).

In one or more embodiments, dedicated routes can be utilized for thetelepresence sessions. For example, heavy users of telepresence sessionsand/or users that have obtained a service upgrade may be provided withdedicated routes using select network elements 955 that are intended toreduce latency in the transmission and/or receipt of the telepresencesession signals. In one or more embodiments, the select network elements955 of the dedicated routes can be dedicated devices that are used onlyfor telepresence sessions and/or for limited functions that includetelepresence sessions. In one or more embodiments, the select networkelements 955 of the dedicated routes can be devices (dedicated devicesand/or non-dedicated devices) that are known to have lower latency, suchas due to lower workloads, higher processing resources, and so forth.

Continuing with the example set forth in system 900, one dedicated route970 is illustrated between media processor 106 of location 903 and thecomputing device 130. This example illustrates the locations 902 and 904utilizing non-dedicated routes through the network 950. The number andconfiguration of dedicated routes can vary, including providing all oronly a portion of the media processors 106 of the locations 902, 903,904 with dedicated routes to and from the computing device 130. Otherdedicated routes can also be utilized, such as where data is beingexchanged with other devices, such as routes directly between mediaprocessors 106 of the locations 902, 903, 904 without routing to thecomputing device 130.

In one or more embodiments, the latency area 980 can be utilized forreconfiguring the dedicated route 970. For instance, the dedicated route970 might normally include network element 955C. But, since networkelement 955C has been determined to be part of latency area 980, thededicated route 970 can be re-configured to avoid use of network element955C through re-routing to network element 955D and to network element955E.

System 900 also provides for injecting delay into the presentation ofone or more of the telepresence configurations 910, including portionsof the telepresence configuration, such as the media content. As anexample, a determination can be made as to which of the locations 902,903, 904 are experiencing the largest latency in presentation of themedia content and/or the video content in the telepresenceconfiguration. One or more delay time periods can be determined based onthis latency and a delay(s) can be injected into presentation of thetelepresence configuration for the other locations. The delay(s) can beapplied to both the media content and the video content or can beseparately applied, including use of different delay periods for themedia content and the video content. By delaying the presentation of theother devices by the delay time(s) associated with the locationexperiencing the most latency, system 900 can provide a synchronizedpresentation of the telepresence configuration. The delay(s) can beinjected by the computing device 130, such as by delaying delivery ofthe media content to locations 902, 903 when location 904 isexperiencing the largest latency for the media content. The delay(s) canalso be injected by the media processors 106 at select locations,including based on a delay period calculated by the computing device 130for the other location and transmitted to the media processors, whenpresenting the telepresence configuration 910 at the display devices 108of the select locations.

FIG. 10 depicts an illustrative embodiment of a method 1000 operating inportions of the devices, systems and/or methods described herein and/orillustrated in FIGS. 1-9. Method 1000 can begin with step 1002 in whicha request for an event telepresence seating is received. The request canbe received at various devices, depending on how the telepresencesession is being managed. For example, in system 900 of FIG. 9, thetelepresence session request can be received by computing device 130from one or more of the media processors 106 at locations 902, 903, 904.In one embodiment, the telepresence session request can be received inconjunction with a social network application.

In step 1004, latency testing can be performed for network elements thatcould potentially deliver signals for the telepresence session (i.e.,the element is part of a possible route for the telepresence session).The type of latency testing can vary and can include loopback testing,such as from the computing device 130 to each of the media processors106 at locations 902, 903, 904. The latency testing can be performedbetween other devices of the network, including between network elementsin order to isolate select network elements that are experiencinglatency issues. The latency testing can be performed at various times.For example, latency testing can be performed in response to receivingthe request for the telepresence session and/or can be performed atother times, such as periodically. Other types of latency testing can beused by the present disclosure, including gathering packet latencytelemetry from all or a portion of the network elements.

In step 1006, a latency area can be detected or otherwise determinedbased on the results of the latency testing. The latency area caninclude network elements experiencing latency issues. The latency areacan further include other network elements that have not been determinedto be experiencing latency issues but due to their position in proximityto those network elements, they are included in the latency area. Instep 1008, routes for the telepresence session can be configured basedon the latency areas. For example, routes can be configured to avoid allor a portion of the network elements in the latency area.

In step 1010, it can be determined whether any of the users, such as atlocations 902, 903, 904, have dedicated routes. For example, a user mayhave a service plan that includes dedicated routes for telepresencesessions. In one or more embodiments, service plan upgrades can beoffered in response to a request for a telepresence session. In one ormore embodiments, usage of telepresence sessions by a user can bemonitored to generate a history for the user. The history can becompared to a usage threshold to determine if a dedicated route shouldbe provided to the user for the telepresence session.

If the user is permitted to utilize a dedicated route then in step 1012the route can be re-configured based on the dedicated route. It shouldbe further understood that the sequence of the steps of method 1000 canbe changed. For example, dedicated routes can first be determined andthen the dedicated routes can be altered when the dedicated route passesthrough, or otherwise relies upon, a network element of the latencyarea. If on the other hand, there are no dedicated routes then method1000 proceeds to step 1014 to determine if latency issues still exist.

If there are no latency issues remaining or if the latency issues arewithin acceptable tolerances then in step 1018 the telepresence sessioncan be provided. If on the other hand, there are latency issues outsideof acceptable tolerances then in step 1016 a delay can be injected intothe presentation of the telepresence configuration at a portion of thelocations. For example, a determination can be made as to which locationis experiencing the greatest latency and a delay period can becalculated based on that latency. A local delay can be injected, such asthe other media processors 106 at the other locations delayingpresentation of the media content and/or the video content tosynchronize the telepresence configurations at each location. Thepresent disclosure can also use a remote delay, such as the computingdevice 130 delaying providing the media content and/or the video contentto a portion of the locations based on a calculated delay period.

In one embodiment, the delay period can be based on a difference inlatency between the different locations. For example, a first locationmay present an image at a 20 ms relative mark, while a second locationpresents the same image at a 40 ms relative mark and a third locationpresents the same image at a 60 ms relative mark. A first delay periodcan be calculated for the first location to be 40 ms based on the delaydifference between the first and third location. A second delay periodcan be calculated for the second location to be 20 ms based on the delaydifference between the second and third location. No delay would beprovided to the third location in this example. The method 1000 canproceed to step 1018 to provide the telepresence session.

Upon reviewing the aforementioned embodiments, it would be evident to anartisan with ordinary skill in the art that said embodiments can bemodified, reduced, or enhanced without departing from the scope andspirit of the claims described below. The embodiments described abovecan be adapted to operate with any device capable of performing in wholeor in part the steps described for methods 800 and 1000.

In one embodiment, the adjusting of the viewing field of the camera canbe performed without movement of the camera. For example, the camera canhave a wide viewing field where only a portion of the viewing field ispresented in the media content at any given time. Shifting the viewingfield to the left or right, as well as up or down, can be performedwithout requiring movement of the camera relative to the event.

In one embodiment, latency corrections can be made based on groups ofusers, without injecting delay and/or configuring routes based onlatency areas for all of the users accessing the media content. Forexample, the computing device 130 can perform latency correction on agroup of user that have telepresence seats in proximity to each other.In another example, the grouping of the users can be based on aproximity to each other in the network. In these examples, by limitingthe number of users, or otherwise dividing up the users, for which thelatency correction is to be performed, the computing device 130 mayreduce calculation time and use of computing resources. In oneembodiment, all of the users can have latency corrections performed fortheir access to the media content and the video content, but the latencycorrections can be performed in different calculations for differentgroups of users.

In one embodiment to further simulate the users being present at theevent, viewing fields can be adjustable, while zooming or other visualeffects can be disabled.

In one embodiment, the latency testing, the determination of the latencyarea, the configuration of the routes and/or the injection of the delaycan be performed at various times, including during the telepresencesession. For example, testing can be periodically performed during thetelepresence session to determine if there has been a change to thelatency area and/or a change to a delay period to be injected into thepresentation of the telepresence configuration by one or more of themedia processors. If a change is detected then corresponding correctionscan be made, such as re-configuring routes and/or changing the delaytime period.

In one embodiment, configuring routes based on latency areas andinjecting a delay into the presentation of the telepresenceconfiguration at a portion of the locations can be selectively appliedbased on thresholds. For example, injecting delay into the presentationof the telepresence configuration for a portion of the locations can beutilized without re-configuring routes based on latency areas when afirst latency threshold has not been satisfied. However, when the firstlatency threshold is satisfied (e.g., latency time periods exceeding apre-determined amount) then both techniques may be applied tosynchronize the telepresence configurations at each of the locations.

In one embodiment, the delay can be implemented to video alone, audioalone and/or to both video and audio. In one embodiment, the delayperiod can be calculated for the video portion of the content and theaudio portion can be synchronized with the video portion.

In one embodiment, the device(s) that perform the functions describedherein can be selected based on capability. For example, if all mediaprocessors 106 have the ability to generate 3D video content then adistributed process can be utilized that does not utilize the computingdevice 130. If only a portion of the media processors 106 have theability to generate 3D content then a master-slave arrangement can beestablished between the media processors 106 without the need to utilizethe computing device 130. If none of the media processors 106 have theability to generate 3D content then the computing device 130 can beutilized for generating 3D content. Similarly, 2D images captured by a2D camera can be transmitted to a device capable of generating 3D videocontent, such as the computing device 130 and/or another media processor106. In one embodiment, the selection of the device(s) can be based onother factors, including processing resources, workload, type of contentand so forth. For example, if only one media processor 106 has thecapability to generate 3D content then the computing device 130 may beutilized along or in conjunction with the select media processor forgenerating the 3D content.

In one embodiment, the providing of the telepresence configuration canbe done in conjunction with a social network application. For example,each of the users can be members of the social network and theestablishing of the communication session between the different userscan be initiated based on selections made from the social networkapplication.

In one embodiment, the presentation of the telepresence configuration bya media processor 106 can be done at multiple display devices. Forexample, in a system that has three display devices positioned adjacentto each other, the media processor 106 can provide a middle displaydevice with the media content for presentation while providing the enddisplay devices with each of the video content from the other users tosimulate the other users being co-located at the event.

Other suitable modifications can be applied to the present disclosurewithout departing from the scope of the claims below. Accordingly, thereader is directed to the claims section for a fuller understanding ofthe breadth and scope of the present disclosure.

FIG. 11 depicts an exemplary diagrammatic representation of a machine inthe form of a computer system 1100 within which a set of instructions,when executed, may cause the machine to perform any one or more of themethodologies discussed above. In some embodiments, the machine operatesas a standalone device. In some embodiments, the machine may beconnected (e.g., using a network) to other machines. In a networkeddeployment, the machine may operate in the capacity of a server or aclient user machine in server-client user network environment, or as apeer machine in a peer-to-peer (or distributed) network environment.

The machine may comprise a server computer, a client user computer, apersonal computer (PC), a tablet PC, a laptop computer, a desktopcomputer, a control system, a network router, switch or bridge, or anymachine capable of executing a set of instructions (sequential orotherwise) that specify actions to be taken by that machine. It will beunderstood that a device of the present disclosure includes broadly anyelectronic device that provides voice, video or data communication.Further, while a single machine is illustrated, the term “machine” shallalso be taken to include any collection of machines that individually orjointly execute a set (or multiple sets) of instructions to perform anyone or more of the methodologies discussed herein.

The computer system 1100 may include a processor or controller 1102(e.g., a central processing unit (CPU), a graphics processing unit (GPU,or both), a main memory 1104 and a static memory 1106, which communicatewith each other via a bus 1108. The computer system 1100 may furtherinclude a video display unit 1110 (e.g., a liquid crystal display (LCD),a flat panel, a solid state display). The computer system 1100 mayinclude an input device 1112 (e.g., a keyboard), a cursor control device1114 (e.g., a mouse), a disk drive unit 1116, a signal generation device1118 (e.g., a speaker or remote control) and a network interface device1120. The devices of computer system 1100 can be found in the previouslyshown figures, such as computing device 130, camera systems 575, 775,camera 175, media processor 106, TV 202 and so forth.

The disk drive unit 1116 may include a machine-readable medium 1122 onwhich is stored one or more sets of instructions (e.g., software 1124)embodying any one or more of the methodologies or functions describedherein, including those methods illustrated above. The instructions 1124may also reside, completely or at least partially, within the mainmemory 1104, the static memory 1106, and/or within the processor orcontroller 1102 during execution thereof by the computer system 1100.The main memory 1104 and the processor 1102 also may constitutemachine-readable media. The instructions 1124 can include one or more ofthe steps described above, including calibration steps, such asdetermining or interpolating viewer distance, determining convergencefrom viewer distance, and so forth.

Dedicated hardware implementations including, but not limited to,application specific integrated circuits, programmable logic arrays andother hardware devices can likewise be constructed to implement themethods described herein. Applications that may include the apparatusand systems of various embodiments broadly include a variety ofelectronic and computer systems. Some embodiments implement functions intwo or more specific interconnected hardware modules or devices withrelated control and data signals communicated between and through themodules, or as portions of an application-specific integrated circuit.Thus, the example system is applicable to software, firmware, andhardware implementations.

In accordance with various embodiments of the present disclosure, themethods described herein are intended for operation as software programsrunning on a computer processor. Furthermore, software implementationscan include, but not limited to, distributed processing orcomponent/object distributed processing, parallel processing, or virtualmachine processing can also be constructed to implement the methodsdescribed herein.

The present disclosure can include a machine readable medium containinginstructions 1124, or that which receives and executes instructions 1124from a propagated signal so that a device connected to a networkenvironment 1126 can send or receive voice, video or data, and tocommunicate over the network 1126 using the instructions 1124. Theinstructions 1124 may further be transmitted or received over a network1126 via the network interface device 1120.

While the machine-readable medium 1122 is shown in an example embodimentto be a single medium, the term “machine-readable medium” should betaken to include a single medium or multiple media (e.g., a centralizedor distributed database, and/or associated caches and servers) thatstore the one or more sets of instructions. The term “machine-readablemedium” shall also be taken to include any medium that is capable ofstoring or encoding a set of instructions for execution by the machineand that cause the machine to perform any one or more of themethodologies of the present disclosure.

The term “machine-readable medium” shall accordingly be taken toinclude, but not be limited to: solid-state memories such as a memorycard or other package that houses one or more read-only (non-volatile)memories, random access memories, or other re-writable (volatile)memories; magneto-optical or optical medium such as a disk or tape.Accordingly, the disclosure is considered to include any one or more ofa machine-readable medium, as listed herein and including art-recognizedequivalents and successor media, in which the software implementationsherein are stored.

Although the present specification describes components and functionsimplemented in the embodiments with reference to particular standardsand protocols, the disclosure is not limited to such standards andprotocols. Each of the standards for Internet and other packet switchednetwork transmission (e.g., TCP/IP, UDP/IP, HTML, HTTP), as well as theexamples for calibration, distance determination, communicationprotocols, and so forth, represent examples of the state of the art.Such standards are periodically superseded by faster or more efficientequivalents having essentially the same functions. Accordingly,replacement standards and protocols having the same functions areconsidered equivalents.

The illustrations of embodiments described herein are intended toprovide a general understanding of the structure of various embodiments,and they are not intended to serve as a complete description of all theelements and features of apparatus and systems that might make use ofthe structures described herein. Many other embodiments will be apparentto those of skill in the art upon reviewing the above description. Otherembodiments may be utilized and derived therefrom, such that structuraland logical substitutions and changes may be made without departing fromthe scope of this disclosure. Figures are also merely representationaland may not be drawn to scale. Certain proportions thereof may beexaggerated, while others may be minimized. Accordingly, thespecification and drawings are to be regarded in an illustrative ratherthan a restrictive sense.

Such embodiments of the inventive subject matter may be referred toherein, individually and/or collectively, by the term “invention” merelyfor convenience and without intending to voluntarily limit the scope ofthis application to any single invention or inventive concept if morethan one is in fact disclosed. Thus, although specific embodiments havebeen illustrated and described herein, it should be appreciated that anyarrangement calculated to achieve the same purpose may be substitutedfor the specific embodiments shown. This disclosure is intended to coverany and all adaptations or variations of various embodiments.Combinations of the above embodiments, and other embodiments notspecifically described herein, are can included by the presentdisclosure.

The Abstract of the Disclosure is provided with the understanding thatit will not be used to interpret or limit the scope or meaning of theclaims. In addition, in the foregoing Detailed Description, it can beseen that various features are grouped together in a single embodimentfor the purpose of streamlining the disclosure. This method ofdisclosure is not to be interpreted as reflecting an intention that theclaimed embodiments require more features than are expressly recited ineach claim. Rather, as the following claims reflect, inventive subjectmatter lies in less than all features of a single disclosed embodiment.Thus the following claims are hereby incorporated into the DetailedDescription, with each claim standing on its own as a separately claimedsubject matter.

What is claimed is:
 1. A method comprising: providing, by a processingsystem including a processor, a telepresence session for a plurality ofparticipants; identifying, by the processing system, latency networkelements based on a latency test performed with respect to a pluralityof network elements of a communication network that each form a portionof a potential route for transmission of telepresence session signals tothe respective participants, wherein the latency network elements and anadditional network element form a latency area, wherein the additionalnetwork element is included in the latency area based on a topology ofthe communication network and is not identified as a latency networkelement; and performing, by the processing system, a latency correctionwith respect to a group of participants in proximity to each other,wherein the group comprises fewer participants than the plurality ofparticipants, wherein performing the latency correction comprisesproviding a delay of a presentation of a telepresence configuration,configuring a route for the transmission of the telepresence sessionsignals avoiding a portion of the latency area, or a combinationthereof.
 2. The method of claim 1, wherein the group of participantshave telepresence seats in proximity to each other.
 3. The method ofclaim 1, wherein the group of participants have proximity to each otherin the communication network.
 4. The method of claim 1, wherein theplurality of participants comprises a first group and a second group, afirst latency correction is performed with respect to the first group,and a different second latency correction is performed with respect tothe second group.
 5. The method of claim 1, wherein the identifyingfurther comprises analyzing latency parameters of network elements ofthe communication network obtained using packet latency telemetry. 6.The method of claim 5, wherein the latency parameters are obtainedperiodically, and wherein the latency parameters are selected based on aknown or predicted cause of latency.
 7. The method of claim 5, whereinthe analyzing is performed during the telepresence session.
 8. Themethod of claim 1, wherein the latency correction is performedresponsive to a latency time period exceeding a predetermined threshold.9. The method of claim 8, wherein a combination of providing the delayof the presentation of the telepresence configuration and configuring aroute for the transmission of the telepresence session signals isperformed responsive to the latency time period exceeding the threshold.10. The method of claim 1, wherein the telepresence session comprises anaudio portion and a video portion, and wherein performing the latencycorrection comprises providing a delay of a presentation of the videoportion and synchronizing the audio portion with the video portion. 11.The method of claim 1, wherein the telepresence session is providedusing a social network application, wherein each of the participants isassociated with the social network application.
 12. A device comprising:a processing system including a processor; and a memory that storesexecutable instructions that, when executed by the processing system,facilitate performance of operations comprising: providing atelepresence session for a plurality of participants; identifyinglatency network elements based on a latency test performed with respectto a plurality of network elements of a communication network that eachform a portion of a potential route for transmission of telepresencesession signals to the respective participants, wherein the latencynetwork elements and an additional network element form a latency area,wherein the additional network element is included in the latency areabased on a topology of the communication network; and performing alatency correction with respect to a group of participants in proximityto each other, wherein the group comprises fewer participants than theplurality of participants, wherein the group of participants havetelepresence seats in proximity to each other, have proximity to eachother in the communication network, or both, and wherein performing thelatency correction comprises providing a delay of a presentation of atelepresence configuration, configuring a route for the transmission ofthe telepresence session signals avoiding a portion of the latency area,or a combination thereof.
 13. The device of claim 12, wherein theplurality of participants comprises a first group and a second group, afirst latency correction is performed with respect to the first group,and a different second latency correction is performed with respect tothe second group.
 14. The device of claim 12, wherein the latencycorrection is performed responsive to a latency time period exceeding apredetermined threshold.
 15. The device of claim 14, wherein acombination of providing the delay of the presentation of thetelepresence configuration and configuring a route for the transmissionof the telepresence session signals is performed responsive to thelatency time period exceeding the threshold.
 16. The device of claim 12,wherein the telepresence session is provided using a social networkapplication, wherein each of the participants is associated with thesocial network application.
 17. A non-transitory machine-readablestorage medium, comprising executable instructions that, when executedby processing system including a processor, facilitate performance ofoperations comprising: providing a telepresence session for a pluralityof participants; identifying latency network elements based on a latencytest performed with respect to a plurality of network elements of acommunication network that each form a portion of a potential route fortransmission of telepresence session signals to the respectiveparticipants, wherein the latency network elements and an additionalnetwork element form a latency area; and performing a latency correctionwith respect to a group of participants in proximity to each other,wherein the group comprises fewer participants than the plurality ofparticipants, and wherein the group of participants have telepresenceseats in proximity to each other, have proximity to each other in thecommunication network, or both, wherein performing the latencycorrection comprises providing a delay of a presentation of atelepresence configuration, configuring a route for the transmission ofthe telepresence session signals avoiding a portion of the latency area,or a combination thereof.
 18. The non-transitory machine-readablestorage medium of claim 17, wherein the additional network element isincluded in the latency area based on a topology of the communicationnetwork.
 19. The non-transitory machine-readable storage medium of claim17, wherein a combination of providing the delay of the presentation ofthe telepresence configuration and configuring a route for thetransmission of the telepresence session signals is performed responsiveto a latency time period exceeding a predetermined threshold.
 20. Thenon-transitory machine-readable storage medium of claim 17, wherein theplurality of participants comprises a first group and a second group, afirst latency correction is performed with respect to the first group,and a different second latency correction is performed with respect tothe second group.